Random Walks in Local Dynamics of Network Losses 
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We suggest a model for data losses in a single node of a packet-switched network (like the Internet) 
which reduces to one-dimensional discrete random walks with unusual boundary conditions. The 
model shows critical behavior with an abrupt transition from exponentially small to finite losses 
as the data arrival rate increases. The critical point is characterized by strong fluctuations of the 
loss rate. Although we consider the packet arrival being a Markovian process, the loss rate exhibits 
non-Markovian power- law correlations in time at the critical point. 
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Many systems, both natural and man-made are or- 
ganized as complex networks of interconnected entities: 
brain cells Q, interacting molecules in living cells 0, 
multi-species food webs p, social networks Q and the 
Internet Q are just a few examples. In addition to the 
classical Erdos-Renyi model for random networks 0, 
new overarching models of scale-free Q or small-world 
H networks turn out to be describe real world examples. 
These and other network models have received extensive 
attention by physicists (see Refs. 0, 0] for reviews) . 

One of particularly interesting problems for a wide 
range of complex networks is their resiliency to break- 
downs. The possibility of random or intentional break- 
downs of the entire network has been considered in the 
context of scale- free networks where nodes were randomly 
or selectively removed 0, 0, , or in the context of 
small-world networks where a random reduction in the 
sites connectivity leads to a sharp increase in the op- 
timal distance across network which destroys its small- 
world nature 0,0,0]- In all these models, the site or 
bond disorder acts as an input which makes them very 
general and applicable to a wide variety of networks. 

Network breakdowns can result not only from a physi- 
cal loss of connectivity but from an operational failure of 
some network nodes to forward data. In the more spe- 
cific class of communication networks, this could happen 
due to excessive loading of a single node. This could 
trigger cascades of failures and thus isolate large parts 
of the network ^| . In describing the operational failure 
in a particular network node, one needs to account for 
distinct features of the dynamically 'random' data traffic 
which can be a reason for such a breakdown. 

In this Letter we model data losses in a single node of 
a packet-switched network like the Internet. We demon- 
strate that such losses may have critical behavior with 
an abrupt transition from an exponentially small to fi- 
nite loss rate as the data arrival rate increases. At the 
critical point the loss rate exhibits strong fluctuations 
which only become Gaussian in the (unrealistically) long 
time limit. Although we model data arrivals as a Marko- 
vian process, the loss rate at intermediate times shows 



long-range power-law correlations in time. When exces- 
sive data losses start, it is more probable that they persist 
for a while, thus impacting on network operation. 

There are two distinct features which must be pre- 
served in modelling data losses in a packet-switched net- 
work: a discrete character of data propagation and the 
possibility of data overflow in a single node. In such a 
network, data is divided into packets which are routed 
from source to destination via a set of interconnected 
nodes (routers). At each node packets are queued in a 
memory buffer before being served, i.e. forwarded to the 
next node. (There are separate buffers for incoming and 
outgoing packets but we neglect this for the sake of sim- 
plicity). Due to the finite capacity of memory buffers 
and the stochastic nature of data traffic, any buffer can 
become overflown which results in discarded packets. 

In the model we suggest here data losses in a single 
memory buffer start when the average rate of random 
packets arrival exceeds the service rate. In such a model 
the transition from free flow to lossy behavior is, on av- 
erage, very steep: when the arrival rate exceeds a certain 
threshold, the buffer becomes full and a finite fraction 
of arriving packets is dropped. Such a sharp onset of 
network congestion is familiar to everyone using the In- 
ternet and was numerically confirmed in different mod- 
els 0]. Here we stress two characteristic consequences 
of the model considered which would be preserved in 
any realistic model allowing for the discrete data prop- 
agation and finite capacity of the nodes: (i) congestion 
can originate from a single node and (ii) loss rate statis- 
tics turns out to be highly nontrivial. The latter makes 
present considerations qualitatively different from, e.g., 
bulk queue models which have been extensively studied 
before 0, 19] but considered loss rate only on average. 
Although fluctuations in network dynamics were stud- 
ied in 20], this was done in a continuous limit for the 
data traffic. In our model there is a more close analogy 
with mesoscopic physics where, e.g., the electron density 
of states in disordered conductors is, on average, a con- 
stant, but its fluctuations are rather nontrivial, cither 
globally or locally |2lj . 
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FIG. 1: The model of data losses: incoming packets randomly 
arrive in discrete time intervals and join the queue of length I 
limited by the memory buffer capacity L. Packets in front of 
the queue are served at the same time intervals. If the queue 
reaches the "boundary" (the buffer is full), newly arriving 
packets are discarded. 



We consider the model of randomly arriving packets 
which form a queue in the buffer and are served at regu- 
lar, discrete time intervals. The length of the queue after 
n service intervals, £ n serves as a dynamical variable. The 
random arrival is modelled as a telegraph noise described 
by the discrete-time Langevin equation, 



n+l 



•6, 



(i) 



where the simplest model for noise £ n is built by assum- 
ing that all incoming packets are of the same length and 
arrive one by one at each service interval with probability 
p. We further assume that one half of a packet is served 
at each interval on a first-come first-served basis. Let L 
be the buffer capacity, i.e. the maximal number of service 
units (half-packets) in the queue. This gives 



1, < t n < L 
0, £ n = L, 



with probability p, and 



6. 



0, l n = , 
-1, 1 < l n < L 



(2) 



(3) 



with probability 1 — p. The meaning of the above condi- 
tions is that either the length of the queue increases by 
one service unit when one packet arrives and one service 
unit is served, or decreases by one when no new packet ar- 
rives. The approximate boundary conditions above cor- 
respond to discarding a newly arrived packet when buffer 
is full (£ n = L) and an idle interval when no packet ar- 
rives at an empty buffer (£ n = 0). We show at the end 
of the Letter that more accurate boundary conditions do 
not change the asymptotic form of our results. 

The main quantity which characterizes congestion is 
the packet loss rate which is defined via the number of 
packets discarded during a time interval N by 



£jv(n ) 



n +N 



n— no + 1 



i,L > 



(4) 



The meaning of this definition is that the arriving packet 
is discarded when by the moment of arrival the queue 
was at the maximal capacity L as illustrated in Fig. ^ 
Thus the continuous limit cannot be exploited for this 
problem which makes the loss statistics profoundly dif- 
ferent from, e.g^, the thoroughly studied statistics of first- 
passage time |22| . We will find the average and the vari- 
ance of the loss rate defined above. Although the arrival 
of packets defined by the Langevin dynamics of Eqs. QJ- 
(PJ) is a Markovian process, we will show that the loss rate 
dynamics turns out to be non-Markovian in the critical 
regime. The reason for this is that the loss rate (0J is de- 
fined entirely by the process occurring at the boundary 
of the random walk (RW) . 

We will express the quantities of interest via the condi- 
tional probability of the queue being of length £ at time 
n provided that it was of length £' at time no, 

where (...) stand for the averaging over the telegraph 
noise of Eqs. Q - The stationary distribution of the 
queue length is related to Q by 

V st {£)= lim G n -n {t,£') = {S£ n ,t} ■ (5) 

no — * — oo 

On averaging the loss rate, Eq. we thus obtain 



(£ N ) =V st (L)NG 1 (L,L), 
while its variance is given by 



(6) 



n + N 
n,m— no + 1 



-A m+1 ,L) 



= (C N ) + 2V st (L)gj{L,L) G m -n-i(L,L) . (7) 

n<m 

To calculate Q (which is non-trivial due to the bound- 
ary conditions of Eqs. © and ©), we note that it is the 
Green's function of the Focker-Planck equation (FPE) 
corresponding to the Langevin equation Q). The FPE 
can be written in terms of the probability P n (£) for the 
queue being of length £ at time n as 



V n+ i(£) =J2w u ,V n {£') , < £,£' < L. 



(8) 



The transition matrix w with elements we^i correspond- 
ing to Eqs. CQl-© is given by 



we j' — pSe-i^ + (1 -p)5i+x i v , < £ < L. 

with the boundary conditions 

' (l-p)(*o,/'+«M')' ^ = 

P (Sl-i,c + $L,e'), £ = L 

(l-p)5t t0 +p6 e , u £' = {) 

k (1 -p)5ll-i +pSe, L , £' = L 



(9) 



W t fi 



(10) 
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Eqs. ©-© describe a usual biased discrete-time RW 
on a one-dimensional lattice However, both the 

quantity to calculate, Eq. (0}, and the boundary con- 
ditions, Eq. (|1U|) . make the problem under consideration 
profoundly different from those in [2^ . 

Eqs. © - (|1UH are clearly non-Hermitian. This leads 
to different right, ip + , and left, eigenfunctions of the 
matrix w (normalized by X^=o ip + (£)ip~ M = 1) : 



wVit = A fc ^> 



it ' 



> fe =A fc V fc 



(11) 



where A& are the eigenvalues, labeled with a discrete 'mo- 
mentum' k. Although there exists a similarity transfor- 
mation which turns the problem into Hermitian (which 
means that all Xk are real), it is convenient to keep the 
above representation unchanged. 

The Green's function of the FPE (JSJ can immediately 
be expressed as Q n = w n which gives 
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FIG. 2: compressibility \ (for L — 1000) shows a fast increase 
of fluctuations in time at the critical point, p = |. 



Diagonalizing the tri-diagonal matrix w defined by 
Eqs. @ and (TDJ, one finds the eigenvalues of Eq. (fTTft 



where k — nn/ (L + 1), n = 1, 2 
eigenfunctions are given by 



A fe = 2v/p(l -p) cos fc, (12) 
L. The appropriate 



?/,±(f) = c k q ±t/z sinfc(£+ 1) - g^sinH 
2 2 P _ P 



(13) 



(L + l)(l-A fc ) ' 



1-p 



The eigenfunctions corresponding to k = are given by 



1-g 
1 - qL+i 



(14) 



and the appropriate eigenvalue, Ao = 1 is separated by 
a gap from the continuous (as L — > 00) spectrum of 
Eq. (^21), unless p = 1/2. The RW is biased towards 
I — > L (full buffer and congested traffic) for p > 1/2, or 
towards £ — > (empty buffer) for p < 1/2. At p = 1/2 
when the RW is unbiased and the eigenvalue spectrum is 
gapless, the fluctuations are strongest. In all cases, since 
Ao = 1 while Xk < 1 for k 7^ 0, it is the isolated solution 
(I14JI which governs the stationary distribution |2J): 



V st {£) 



lim Qn 



(15) 



Noticing that Gi(£,£') = wg t gi so that Gi(L,L) = p, 
one finds the average loss rate from Eqs. © and l|15l) as 



1 q L+1 - 

- { c N )= P - LTr 



2p-l, p> 



1 L»l 



1 



P = 2' 

_L 

2 ' 



P< 



so that the loss rate is a constant of order 1 for p > 1/2, 
a small fraction of the buffer capacity for p — 1/2 and 
an exponentially vanishing fraction for p < 1/2. This 
straightforward result could be obtained directly from 
the Langevin description. The matching between these 
three asymptotic regimes takes place in a narrow region 
(of width ~ around p = | . 

The result for the variance, Eq. (JJJ, is convenient to 
express in terms of the 'compressibility' defined by 

(SC%) = xn (£n) , SC N (n) = C N {n) - (£ N ) . (16) 

From Eqs. Q and {T3J| we find 



, 4p(l-p) x 



L + 1 



^ (1 

fc>0 v 



sin fc 
A^ 



1 - 



1 l-\ 
iV 1 — At 



(17) 



The behavior of % is illustrated in Fig. [21 which shows 
its fast increase at the critical point, p = 1/2. Using 
Eq. (JT35J for A fc , it is easy to simplify Eq. l(T7|) . We find 
that a steady-state regime (when one neglects the N- 
dependent term in the square brackets above) is reached 
for N > N where 

JV„= [(2p-l) 2 + (7r/L) 2 ] -1 • 
In this regime, the compressibility saturates at 



^fe^, |2p-l|i»l 



|2p- 



|2p-l|L«l 



Thus, the compressibility diverges at the transition point 
p = 1/2 in the thermodynamic limit, L — > 00 and 



N/L 2 



00. The variance (|16f) remains finite at the 
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transition point and in the thermodynamic limit it obeys 
the central limit theorem. 

However, at the critical point, p = 1/2, the steady- 
state regime is reachable only at unrealistically long times 
N^>NqocL 2 . In the intermediate regime, 1 <C N -c 7V , 
the compressibility rapidly increases with time: 



Xn 




1 



(18) 



so that the variance exceeds the average value of the loss- 
rate and its distribution is no longer normal. More im- 
portantly, in this regime the fluctuations of the loss rate 
are no longer Markovian as they exhibit long-time corre- 
lations. To show this, we consider the temporal correla- 
tion function of the loss rate defined by 



R 2 (N, M) 



(SC N (0)SC N (M)) 



(6C 2 



M > N . 



Nl 



We obtain an exact expression for R 2 {N, M) similarly 
to that for xn, Eq. I|17f) . omitted for brevity. In the most 
relevant regime, iV 3> N 3> 1 and M > N, it reduces to 



R 2 (N, M) 



pN 



Xn 



-M(2p~iy/2 



ttM 



\2p- l|erfc(|2p- l\y/M/2 



At the critical point this reduces using Eq. Ijl8(l to 



R2(N,M)\ p=1/2 = c- 1 ] f 



N 
2ttM 



(19) 



(20) 



This long-time correlation (in spite of the packet arrival 
being Markovian) is another clear sign of criticality. 

Let us note that the boundary conditions in Eq. itTol) 
correspond to simultaneous arrival and service of pack- 
ets. In this case overflown packets are only partially dis- 
carded. In more realistic models the overflown packets 
should be discarded completely. To reflect this, we can 
choose one of the standard procedures: service first or 
packet arrival first. This is straightforward to formu- 
late: the transition matrix remains the same in the bulk, 
Eq. 10, while changes in 3 x 3 blocks in the boundary 
corners. In solving the eigenvalue problem (|ll|l the ap- 
propriate boundary layer states can be eliminated. This 
reduces our problem to that described by Eqs. Q and 
(I10J1 but with a smaller number of states and different 
(and dependent on eigenvalues) corner elements on the 
main diagonal. This can be solved in a similar way as the 
model of Eqs. (jSll- lfTUj) and the dependence on N and M 
turns out to be the same in the asymptotical regime of 
Eqs. dHJ-GDJ- 

In conclusion, we have demonstrated that the stochas- 
tic nature of discrete data traffic in packet-switched net- 
works (e.g., the Internet) results in a critical behavior 



with an abrupt transition from free to lossy operation at 
the level of a single node when the arrival rate reaches a 
certain critical value. The critical point is characterized 
by strong fluctuations and long-memory effects in the loss 
rate. This leads to an operational failure of a single node 
which can contribute to cascaded failures and thus con- 
gestion of large parts of the network. We intend to use 
the results of the present model as building blocks for 
describing such a congestion within the framework that 
accounts also for the topological disorder j^]. 
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